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We present a dynamical system that naturally exhibits two unstable attractors that are completely 
enclosed by each others basin volume. This counter-intuitive phenomenon occurs in networks of 
pulse-coupled oscillators with delayed interactions. We analytically show that upon continuously 
removing a local non-invertibility of the system, the two unstable attractors become a set of two 
non-attracting saddle states that are heteroclinically connected. This transition equally occurs 
from larger networks of unstable attractors to heteroclinic structures and constitutes a new type of 
singular bifurcation in dynamical systems. 

PACS numbers: 05.45.Xt, 02.30. Oz, 



The concepts of attractor and stability are at the core 
of dynamical systems theory jl| because attractivity and 
stability determine the long term behavior and often the 
typical properties of a system. Attraction and stability 
which may change via bifurcations are thus fundamen- 
tal to modeling in all of science and engineering. For 
systems with smooth and invertible flows these concepts 
have long been studied and are well understood, allow- 
ing classifications of dynamical systems and their bifur- 
cations, for example by using topological equivalence and 
normal forms. 

Dynamical systems with non-smooth or non-invertible 
fiows, such as hybrid or Fillipov systems are far less 
understood although they model a variety of natural phe- 
nomena, ranging from the mechanics of stick-slip motion 
and the switching dynamics of electrical circuits, to the 
generation of earthquakes and the spiking activity of neu- 
ral networks 0,0, Si- For instance, spiking neurons in- 
teract by sending and receiving electrical pulses at dis- 
crete instances of time that interrupt the intermediate 
smooth interaction-free dynamics. This neural dynamics 
and similarly that of, e.g., cardiac pacemaker cells, plate 
tectonics in earthquakes, chirping crickets and fiashing 
firefiies are often modeled as pulse-coupled oscillators. 

Such hybrid systems display dynamics very different 
from that of temporally continuous or temporally dis- 
crete systems. Networks of oscillators with global ho- 
mogeneous delayed pulse-coupHng may robustly exhibit 
unstable attractors tg| (invariant periodic orbits that are 
Milnor attractors but locally unstable). In the pres- 
ence of noise, these systems exhibit a dynamics akin 
to heteroclinic switching j^, a feature that is function- 
ally relevant in many natural systerns such as in neural, 
weather and population dynamics l^j, 0|. Rigorous anal- 
ysis shows that invertible systems in general cannot 
have unstable attractors and that a saddle state can in 
principle be converted to an unstable attractor by lo- 
cally adding a non-invertible dynamics onto the stable 
manifold. However, the potential relation of unstable at- 



tractors to heteroclinic cycles is not well understood and 
it is unknown whether and how unstable attractors may 
be created or destroyed via bifurcations. 

In a network of pulse-coupled oscillators we here 
demonstrate the existence of two unstable attractors that 
are enclosed by the basin of attraction of each other. We 
explain this counter-intuitive phenomenon: Continuously 
lifting the local non-invertibility of the system with two 
unstable attractors creates a standard heteroclinic two- 
cycle. This transition equally occurs from large networks 
of unstable attractors to heteroclinic structures and con- 
stitutes a new type of singular bifurcation in hybrid dy- 
namical systems. 

We consider a network of N oscillatory units with a 
state defined by a phase-Hke variable e M, ? e 

{1,2, ... ,N}, that increases uniformly in time t 
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Upon crossing a threshold at time ts, (pi {tg 
is instantaneously reset. 



(1) 



> 1, unit i 



(j), (<+) := lim 0, {ts +r) = K {<j>, {ts)) . (2) 

Here K {(j)) = U'^ {R{U {(j)) - I)) is determined by a 
smooth, unbounded, strictly monotonic increasing rise 
function U {(f>) normalized to U {0) = and U {I) = 1 
and a smooth non-negative reset function R satisfying 
R{0) = 0. In addition to the reset ^ a pulse is sent 
which is received by all units j after a delay time t > 0, 
inducing a phase jump 



Cj), {ts + t) = H,^^ ((i,+T) )) 



(3) 



with interaction function {(j)) — U^^ {U {4>) + e) and 
coupHng strength Sji from unit i to unit j. We set 
Je {(p) ^ K o He {(j)) and denote a phase shift by S,,{(l)) — 
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Figure 1: (color online) Two unstable attractors enclosed by 
the basins of each other (c = 0). (a) Phases (pi {ta) (dots) 
of all units at times ts just after the s-th reset of a reference 
unit i — 1. Lines indicate the phases on the invariant orbit 
Ai (a, solid) and A2 (dashed). Arrows mark times of small 
phase perturbations which induce switches from Ai to A2 
or vice versa. The shaded area highlights a switch from Ai 
to A2 that is shown in detail in Fig. [2] (b) Fraction Vi of 
5000 trajectories reaching the periodic orbit Ai {• : i = 1, 
X : i = 2) starting from random phases distributed uniformly 
in a box of side width 2S centered around <^ = oi on the orbit 
Ai. For < 5 < 5crit ~ 0.05 all trajectories reach the orbit A2 
{v2 ~ 1), indicating that A\ is enclosed by the basin volume 
of A2 and in particular that Ai is an unstable attractor. 



This system represents, for instance, an abstract 
model of neuronal oscillators with a membrane poten- 
tial Uiit) = U{<j)i{t)). The neurons' responses to in- 
puts are described by increasing the potentials instanta- 
neously by an amount eij , that represents the transferred 
charge from the pulse sending (presynaptic) neuron j to 
the pulse receiving (postsynaptic) one i. If this input 
is supra-threshold, Ui[t) — Ui{t~) + Eij > 1, unit i is 
partially reset to 



{t+) ^R{u, {t)-l)>Q. 



(4) 



This accounts for remaining synaptic input charges which 
are not used to reach the threshold and which contribute 
to the potential after reset d. For i?(C) = we recover 
the model analyzed in previous studies [H] which has a 
local non-invertibility since the original phase of a unit 
cannot be recovered after it received supra-threshold in- 
put and was reset to Je (</>) = 0. For an invertible R the 
flow becomes locally time invertible. 

Here we focus on a homogeneous network of all-to- 
all coupled excitatory units without self-interaction, i.e. 
Eij = (1 — (5ij)e, £ > 0. The permutation symme- 
try implies invariant subspaces of two or more synchro- 
nized units and thus the possibility of robust hetero- 
cHnic cycles, cf. For the numerical simulations pre- 
sented below we fix £ = 0.23, t = 0.02, a rise function 
U{4>) = \ log (1 + (exp(6) - 1) 4>) with b = 4.2 and par- 
tial reset i?(C) = cC, with parameter c £ [0, 1] which is 
invertible for all c > 0. For these parameters the model 
exhibits short switching times between periodic orbits 
which simplifies the presentation of the analysis below; 
however, the studied phenomena is robust against struc- 
tural perturbations in r, e and the function U . 



For locally non-invertible dynamics (c = 0) the above 
system exhibits unstable attractors in a large fraction 
of parameter space and for different network sizes 
@|. For the above parameters, the smallest system in 
which we observed unstable attractors has TV = 4 units. 
Curiously, numerical simulations, e.g. Fig. [1^, indicate 
that such a system exhibits two unstable attractors each 
of which is fully enclosed by the basin volume of the other 
attractor. Fig. [TJd. 

We confirm these numerical findings analytically. 
Given a periodic orbit A, define the basin of attraction 
B{A) as the set of points in state space that converge 
to A in the long time limit. Below we show that in the 
system (II])-((3]) with R[Q = there is a pair of periodic 
orbits A-i and A2 such that a full measure set of points 
of an open neighborhood of Ai is contained in the basin 
B{A2) and vice versa. 

To study the dynamics in detail we use an event based 
analysis, cf. e.g. The event when a unit i sends a 
pulse is denoted by Si, the reception of a pulse from unit 
j by Tj and simultaneous events are enclosed in paren- 
theses. For given parameter c G [0,1], a simple saddle 
periodic orbit Ai (cf. Figs.[T^ and[3H) is uniquely deter- 
mined by the cyclic event sequence 



E{Ai) = (si,S2) (?'i,?'2, 53,54) {r:i,ri) 



(5) 



By exchanging the indices (1,2) ^ (3, 4) in ^ we obtain 
the event sequence of a permutation equivalent periodic 
orbit A2. Both orbits lie in the intersection of the two 
invariant subspaces {0i — (1)2} and {03 = (jii} with syn- 
chronized units (1,2) and (3,4), respectively, allowing a 
robust heterocHnic connection between them. As it turns 
out below the local stability and non-local attractivity 
properties of the Ai depend on the parameter c. 

We now first locally reduce the infinite dimensional 
state space of the hybrid dynamical system with de- 
layed coupling to three dimensions: Local to Ai and A2 
the state space reduces in finite time Q to an eight- 
dimensional state space spanned by the four phases 
4> = {4>i,4>2,4'3,4'i): and the four times cr^ > 0, i £ 
{1,...,4} elapsed since the most recent pulse gener- 
ation of oscillator i. We consider the subset M. = 
{(0, cr) I CTi > r, i e {1, . . . , 4}} of the state space where 
all pulses have been received: Then the state space is 
effectively four dimensional, since the exact values of the 
Ui > T do not infiuence the dynamics. Due to the uni- 
form phase shift ([l]), Ai is a straight fine in M after 
the last and before the first event in the sequence |[5|). 
We denote the point in the center of this line by ai and 
consider states with phases 4> = ai + (^i, (52, ^3, <54) in 
a neighborhood. Because of shift invariance we may fur- 
ther fix (5i =0, being left with a locally three-dimensional 
representation Vi C of the original state space with 
states ((52,53,(54) e Vi. Similarly, we have a local three- 
dimensional representation ((54, i5i, (52) G 7^2 of the state 
space around 02 £ ^A^ A2 , constructed analogously to 
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Figure 2: (color online) Structure of the three-dimensional re- 
duced state space for c = showing that the Ai are unstable 
attractors enclosed by the basins of each other, (a) Repre- 
sentations Pi of the state space in a neighborhood of Ai G Vi 
(cross) and A2 £ ^2 (ball). All trajectories starting in the set 
Ci (close to Ai) lead to a switch to A^. The line with arrows 
shows a sample trajectory of the marked switch from Ai to 
A2 in Fig. [1^. (b) Projection of Vi onto the S2-64, plane and 
(c) of P2 onto the 81-62 plane, illustrating that, except for 
the lower dimensional subset Si, the attractor Ai is enclosed 
by Ci, i.e. the Ai are unstable attractors. 

ai, this time fixing 63 = 0. There is an open neigh- 
borhood of Ai in the full eight-dimensional state space 
from which every orbit crosses Vi after at most eight 
events (one cycle) . In this sense Vi is a three-dimensional 
Poincare section in a neighborhood of Ai . 

For arbitrary c € [0, 1] there are regions in Vi and V2 
from which all trajectories evolve back to points in ei- 
ther Vi or V2- Between these regions we derive return 
maps and their domains which follow directly from the 
definition of the local state space and the event sequence 
(Fig. [2] visualizes domains of the key maps and a sample 
trajectory for c = 0). For instance, the orbit Ai is en- 
closed by the three-dimensional domain Ci C Vi of the 
map F : Ci Vi, 

F iS2,63,Si) = (sign (62) [H2e oSrOH,{T+ \62\) 

~ H2e o Sr + ^s.\ ° H, (t - \d2\)],S':„S'^) 

(6) 

which is determined by the event sequence 

E (Ci) = (si) (S2) (ri) (r2, S3, S4) {rs, ''4) (7) 
or its equivalent with permuted indices 1^2. Here 

S', = H, o Sr o J, {H, {a + T + 6,) + \52\) 

+ 1- H2eOSrOH,{T+\S2\)-a (8) 

for i G {3,4}, where the phase difference a between the 
two synchronized clusters at ai is determined by 

H,oSrOj2e{a + T) + l- H2e O Sr o H, (t) . (9) 
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Figure 3: (color online) Heteroclinic switching (c > 0). (a) 
Phases 4>i (ts) (dots) as in Fig. [iji for c = 0.05. The invariant 
periodic orbits Ai, being unstable attractors at c = 0, still 
exist for c > (solid and dashed line). Starting in a state 
near Ai leads to repeated switching between the two states. 
Inset: Phase difference a ^ (solid) and side width w of the 
set T>'i l|lip (dashed) change continuously upon increasing c 
from zero, (b) Switching times Tk to the k-th switch (x: 
c = 0.1, o: c = 0.01) increase exponentially with k, indicating 
that the dynamics evolve near a heteroclinic cycle between 
the invariant states. Inset: Fitting Tk — 76"* to the switching 
times for several values of c we find a divergence of /t as c — > 0. 

For \S2\ > 0, F is expanding in the (52-direction since 

\{F{6)),\>k\S2\ (10) 

with k = min0g[o^i] H'^{(l)) > 1. For (52 = we obtain a 
map with the same explicit form as in ^ but with event 
sequence as in ^ whose domain is a subset of the two- 
dimensional invariant set Si = {S G Vi \ 62 = 0} where 
units 1 and 2 are synchronized. States in iSi converge 
to Ai in the long time limit. Similarly, points in ^2 = 
{S £ V2\S4 = 0} reach A2 asymptotically. 

If the system is locally non-invertible (c — 0) the dy- 
namics is as follows (see Fig. [21): Since Je{(l)) = 0,6'^ — 
according to ([8]) and hence F maps Ci into two one- 
dimensional lines Vi = F{Ci). Since F is expanding 
in 62 (fTO]) . all points in I?i fl Ci are mapped after a fi- 
nite number of interactions into Pi \ Ci . The set Vi \ Ci 
is mapped to £2 C 1S2 and from there to the attractor 
A2. In Fig. [2] we have plotted a sample trajectory for the 
switch marked in Fig. [1^. For the positive measure set 
Ci U <Si, that encloses Ai, we thus have Ci C B {A2) and 
only the zero measure subset Si converges to Ai. Thus 
Ai is an unstable attractor. Permutation symmetry im- 
plies analogous dynamics near A2. Taken together, for 
c = the periodic orbits Ai and A2 are unstable attrac- 
tors enclosed by the basins of each other. 

If we remove the local non-invertibility (c > 0), the 
dynamics changes qualitatively as shown in Fig. [31 The 
two periodic orbits Ai with event sequence ((H) still exist, 
only the phase difference a changes continuously with c 
(Fig. [3K)- Starting in a state near one of the Ai leads to 
trajectories with switching between both. The switching 
time increases exponentially with the number of switches 
(Fig. [3b) indicating that these dynamics originate from 
an orbit near a heteroclinic two-cycle. Furthermore the 
switching times diverge as c ^ (cf. Fig.[3h), suggesting 
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the transition to a network of unstable attractors at c = 
0. Indeed, the structure of the domains of all return 
maps does not change qualitatively when c increases from 
zero. However, since becomes invertible for c > 0, 
according to ([HI) a phase difference |(53 — (54| shrinks under 
the return map F, but does not collapse to zero as for c = 
0; hence the image !)[ = F (Ci) stays three-dimensional. 
It consists of tubes (around the original lines T>i) with a 
square cross-section of side width 

w{c) ^ H.oSrO U^^ (ce) ~H,oSrO (0) (11) 

that continuously increases with c from w(0) = 
(Fig.[3K)- This reflects the local c-dependent contraction 
of the state space according to ^ and All maps 
with domains that have a non-empty intersection with 
V'l map V'l to a three-dimensional state space volume 
around A2 that is a subset of C2 U <S2. Taken together, 
states in the three-dimensional set Ci evolve to states in 
a positive measure subset of C2 U 1S2 that encloses A2. 
Using symmetry again, C2 is analogously mapped to a 
subset of Ci U iSi . This explains the observed switching. 

The unstable attractors are converted to non- 
attracting saddles by locally removing the non- 
invertibility of the dynamics, which is reflected in the ex- 
pansion of Pi, i G {1, 2} to positive measure sets V[ when 
increasing c from zero. Moreover, states in the subset of 
Ci with synchronized units 3 and 4, i.e. states in the set 
{5 & Ci\6z — 84} are mapped to 52 and thus reach the 
orbit A2 asymptotically. Hence, this set together with all 
its image points in Vi and V2 form a heteroclinic connec- 
tion from Ai to A2. Thus, by symmetry, the network of 
two unstable attractors (c — 0) continuously bifurcates 
to a heteroclinic two-cycle (c > 0). 

The underlying mechanism relies on the interplay of 
the local instability (fTOl) and the parameter dependent 
contraction induced by the reset (|4]), implying the same 
transition in larger systems (not shown) . For locally non- 
invertible dynamics these display larger networks of un- 
stable attractors [H| with a link between two attractors 
Ai Aj if every neighborhood of Ai contains a pos- 
itive basin volume of Aj. Upon lifting the local non- 
invertibility each link in this network is replaced by a 
heteroclinic connection. 

In summary, we have presented and analyzed the 
counter-intuitive phenomenon of two unstable attractors 
that are enclosed by each other's basin volume. We ex- 
plained this phenomenon by showing that there is a con- 
tinuous transition from two unstable attractors to a het- 
eroclinic two-cycle. Larger networks of unstable attrac- 
tors equally show this transition to more complex hete- 
roclinic structures. It constitutes a new type of singu- 
lar bifurcation in dynamical systems and establishes the 
first known bifurcation of unstable attractors. Moreover, 
our results show that this bifurcation occurs upon con- 
tinuously removing the non-invertibility of the system, 
whereas both the non-invertible (c = 0) and the locally 



invertible (c > 0) system exhibit equally discontinuous 
interactions. This explicitly demonstrates that the local 
non-invertibility and not the discontinuity is responsible 
for the creation of unstable attractors. 

The continuity of the bifurcation has theoretical and 
practical consequences: For instance, one may investi- 
gate features of a system exhibiting heteroclinic switch- 
ing by studying its limiting counterpart with unstable 
attractors. Furthermore, this may help designing sys- 
tems with specific heteroclinic structure, for instance in 
artificial neural networks, and guide our understanding 
of time series of switching phenomena in nature, cf. 0]. 
The associated limiting systems with unstable attractors 
may not only be analytically accessible, also numerical 
simulations can be performed in a more controlled way 
because typical problems with simulations of heteroclinic 
switching, e.g. exponentially increasing switching times 
and exponentially decreasing distances to saddles, do not 
occur if the heteroclinic switching is replaced by networks 
of unstable attractors. 
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ation. Supported by the Federal Ministry of Education 
& Research (BMBF) Germany, Grant No. 01GQ0430. 
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